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DETAILED ACTION 

Response to Arguments 

Applicant's arguments liave been fully considered but they are not persuasive. 

Applicant argues that Toguri's "reproduction time" does not meet the recited "time 
prompt" in the sense of triggering a synchronous display. Rather, the applicant 
interprets "reproduction time" as describing the duration of the media. However, 
nowhere in Toguri is there a specific definition; he only states that it is included in the 
metadata. Paragraph 102 merely states "the reproduction time shows the reproduction 
time of the AV contents." This does not clarify the term, and given the context and lack 
of specificity, it is equally reasonable to interpret "reproduction time" as describing the 
time at which something is to be reproduced. One of ordinary skill would recognize that 
such timing information would be of use, for example, in the information integrating and 
synchronizing reproduction processing module. In that case, it would meet the claimed 
"time prompt." 

Even if the Applicant's interpretation of "reproduction time" was accepted, Toguri 
would still meet the claimed transmission of a time prompt by virtue of inherency as 
follows: Terminal apparatus 9 receives both AV contents and metadata, "integrates 
and synchronizes" these objects, then outputs them to a terminal output that includes 
multiple displays [Fig. 19, para. 149; Fig. 10, paras. 92-93;]. The AV contents are 
displayed synchronously with the extra media (metadata). For synchronous display to 
occur [44, Fig. 4], there must necessarily exist a "time prompt" that triggers the 
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synchronous display of tine two different pieces of data. Without a time prompt there is 
no meaningful manner in which to synchronize the displays. Moreover, since all of the 
information originates not at the terminal itself but arrives via the internet, the timing 
information is also necessarily transmitted to the device [Fig. 3, para. 72]. 

To summarize, claim 22 is rejected over Chen and Toguri because Chen teaches 
the portable device limitations, and Toguri meets the storage and synchronous display 
elements, either directly with the "reproduction time" or via inherency. While Toguri 
does not teach separate devices for displaying different data, it does teach separate 
synchronous displays that are analogous to the application of Chen [see Chen, paras. 
28, 59]. Taken together, the references would suggest to one of ordinary skill that the 
separate devices in Chen could be operated in concert by a synchronization module 
taught by Toguri. Therefore, the references teach all elements of the claims and the 
rejections stand. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 22-44 and 69-71 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chen et al., US 2002/0122137 in view of Toguri, US 2002/0053085. 
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3. Regarding claim 22, Chen discloses a method of providing content data to a 
viewer of a media presentation in conjunction with the media presentation, comprising: 

providing a viewer of the media presentation with a portable device, the portable 
device being remote from the presentation of the media presentation and capable of 
receiving wireless communications and displaying content data relating to the media 
presentation [TCD 120, Fig. 3, paras. 27, 31, 43]; 

transmitting content data to the portable device [e.g., paras. 30, 42]; and 

displaying the content data on the portable device [video output 126 and 
screen 127, Fig. 3; paras. 30, 43]. 

Chen is silent on storing data in the receiving device before being displayed in 
response to timing information. Toguri teaches accumulating content data in the cache 
memory of a terminal device [AV contents and metadata are transmitted to and 
stored in terminal apparatus 9; one option is batch (as opposed to real-time) 
delivery, i.e. the data is stored in advance of presentation, paras. 90, 91, 100]. 
Toguri also transmits a time prompt to the portable device, the time prompt triggering 
the content data to be displayed on the portable device such that the content data is 
displayed in synchronization with the presentation of a corresponding portion of the 
media presentation ["reproduction time" or time prompt is used by the terminal to 
synchronously display metadata corresponding to the media presentation, 
Fig.S12 and S14, Fig. 2, paras. 20, 21, 93; Fig. 10, paras. 9, 79; terminal integrates, 
synchronizes, and displays AA/ contents (analogous to the claimed "media 
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presentation") with metadata (analogous to the claimed "content data"; para. 
149]. 

Although Chen lacks specific disclosure of caching and timing operations, he 
does teach that the presentation of streams may be executed automatically [para. 29], 
implying the need for timing information to provide a trigger. Chen also uses event 
identifiers to select and display auxiliary streams [paras. 55, 57]. These 
synchronization techniques would suggest to one of ordinary skill that a time prompt 
could also be used to trigger the display of corresponding auxiliary information as taught 
by Toguri. Therefore, the combination of Chen and Toguri is an obvious in order to 
synchronize primary content and metadata, for example to display player portraits or 
statistics at a relevant time in a televised sporting event [see Chen, para. 28] or to 
synchronize questions and answers in a play-along trivia game [see Chen, paras. , 59]. 

4. Regarding claims 23 and 24, Chen discloses a method wherein the at least one 
time prompt is transmitted by way of infrared signal or RF signal [para. 40]. 

5. Regarding claims 25-32, Toguri discloses a method wherein the media 
presentation or the content data may comprise graphics, text, video, audio, or a 
combination of audio and video data [e.g., Chen Abstract; Toguri paras. 149 and 
150]. 
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6. Regarding claim 33, Chen discloses a method wherein the at least one time 
prompt is representative of a time of day [TCD selects particular stream at 
predetermined time of day, para. 30]. 

7. Regarding claim 34, Chen discloses a method wherein the at least one time 
prompt is representative of a time at which the media presentation starts [Toguri, 
paras. 103, 104, 118-121]. 

Regarding claims 35 and 36, Chen discloses a method wherein the portable 
device comprises speakers and/or a display [Fig. 3, para. 43]. 

Regarding claims 37 and 38, Chen does not refer to the mobile device as a 
"personal digital assistant" or cellular phone. However, the TCD described is comprised 
of an antenna, transceiver, speaker, and input keys [see Figs. 1, 3]. Given the 
component described, a person of ordinary skill would find it obvious that a PDA or cell 
phone could be used as the portable device. Both devices have the same components 
as the disclosed TCD and are capable of the same functions. The benefit is that these 
devices already have the capability to communicate and display data and they are 
ubiquitous among the public; additional portable devices need not be supplied to 
viewers that already possessing this type of device. This could allow restaurants, for 
example, to service more customers with a smaller inventory of "TCDs" per se. 
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8. Regarding claim 39, Toguri discloses a method wherein the media presentation 
is a pre-recorded presentation [Fig. 21, para. 160]. 

9. Regarding claim 40, Chen and Toguri disclose a method wherein the pre- 
recorded presentation is a movie [Chen paras. 53-56, Toguri paras. 73, 108, 129]. 

10. Regarding claim 41 , Chen discloses a method wherein the pre-recorded 
presentation is a movie and the content data is text captioning [closed caption data is 
an example of auxiliary information that can be provided via TCD rather than TV, 
para. 10]. 

1 1 . Regarding claim 42, Chen discloses a method wherein the pre-recorded 
presentation is a movie and the content data comprises descriptive audio for the blind 
[audio data can be presented via TCD, e.g., Chen Abstract; Toguri paras. 149 and 
150]. 

12. Regarding claim 43, Chen discloses a method wherein the content data is a 
visual narrative, the visual narrative being displayed in one of a plurality of languages 
[para. 43]. 

13. Regarding claim 44, Chen discloses a method wherein the content data is an 
audio narrative, the audio narrative being played in one of a plurality of languages 
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[para. 43; e.g., Chen Abstract; Toguri paras. 149 and 150]. 

14. Regarding claims 58, 61 , and 66, Chen discloses a method wherein the media 
presentation is live [e.g. a sports broadcast, para. 28]. 

1 5. Regarding claim 70, Toguri discloses a method wherein content data is 
transmitted to the portable device at the start or slightly in advance of the start of the 
media presentation [para. 90]. 

16. Regarding claim 71 , Chen discloses a method further providing inputs on the 
portable device adapted to receive information from the viewer [inputs 129, 130, Fig. 
3]. 

1 7. Claims 46-68 and 72-79 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Toguri, US 2002/0053085in view of Chen et al., US 2002/0122137. 

18. Regarding claim 46, Toguri discloses a method of interactive communication 
during a media presentation, comprising: 

presenting the media presentation at a first location using media presentation 
data, the media presentation data having at least one time code associated with-the 
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media presentation data [para. 21; time code is "reproduction time" in region 61 of 
DB21, paras. 100, 101]; 

caching the media presentation data in a memory [AV contents and metadata 
are transmitted to and stored in terminal apparatus 9; one option is batch (as 
opposed to real-time) delivery, i.e. the data is stored in advance of presentation, 
paras. 90, 91, 100]; 

transmitting the media presentation data to the portable device and while the 
media presentation is being presented, detecting one of the at least one time code 
associated with the media presentation data ["reproduction time" or time prompt is 
used by the terminal to synchronously display metadata corresponding to the 
media presentation, S12 and S14, Fig. 2, paras. 20, 21, 93; Fig. 10, paras. 9, 79]; 

determining when the media presentation data should be displayed based on the 
contents of the at least one time code and displaying the media presentation data on 
the portable device in relative synchronization with the presentation of a corresponding 
portion of the media presentation [terminal integrates, synchronizes, and displays 
AA/ contents (analogous to the claimed "media presentation") with metadata 
(analogous to the claimed "content data"; para. 149]. 

While Toguri does not perform the above functions in connection with a portable 
device, he does discuss separate display regions for content and metadata [Fig. 19, 
para. 149]. Chen teaches providing a viewer of the media presentation with a portable 
device, the viewer being located at a second location remote from first location [TCD 
120, Fig. 3, paras. 27, 31, 43]. Given the separate display regions disclosed by Toguri, 
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it would have been obvious to one of ordinary skill that one of the displays could be 
integrated in a portable device. The benefits of remote display units include allowing 
personalized data to be sent to individuals in a public setting, and enabling parental 
control of content at home [See Chen, para. 30]. 

1 9. Regarding claim 47, Toguri discloses a method of providing content data to a 
viewer of a media presentation in conjunction with the media presentation, comprising: 

transmitting the content data to a terminal using first receiver signals at the start 
or slightly In advance of the start of the media presentation and accumulating content 
data In a cache memory of the portable device [AV contents and metadata are 
transmitted to and stored in terminal apparatus 9; one option is batch (as 
opposed to real-time) delivery, i.e. the data is stored in advance of presentation, 
paras. 90, 91, 100; storage module 108, Fig. 21]; 

transmitting at least one message to the portable device using second receiver 
signals, the at least one message a time when the content data should be presented on 
the portable device such that the content data and a corresponding portion of media 
presentation are displayed In synchronization ["reproduction time" or time prompt is 
used by the terminal to synchronously display metadata corresponding to the 
media presentation, S12 and S14, Fig. 2, paras. 20, 21, 93; Fig. 10, paras. 9, 79]; 
and 

presenting the data on the portable device to the viewer in synchronization with 
the media presentation [terminal integrates and synchronizes, and displays A/v 
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contents (analogous to the claimed "media presentation") with metadata 
(analogous to the claimed "content data"; para. 149]. 

While Toguri does not perform the above functions in connection with a portable 
device, he does discuss separate display regions for content and metadata [Fig. 19, 
para. 149]. Chen teaches providing a viewer of the media presentation with a portable 
device, the portable device comprising at least two receivers, the portable device- 
capable of presenting content data relating to the media presentation to the viewer in 
conjunction with the media presentation [TCDs 120, Fig. 3, paras. 27, 31, 43]. Given 
the separate display regions disclosed by Toguri, it would have been obvious to one of 
ordinary skill that one of the displays could be integrated in a portable device. The 
benefits of remote display units include allowing personalized data to be sent to 
individuals in a public setting, and enabling parental control of content at home [See 
Chen, para. 30]. 

20. Regarding claim 46, Toguri discloses a method of providing content data to a 
viewer of a media presentation in conjunction with the media presentation, comprising: 

transmitting and accumulating content data in the cache memory of the portable 
device [AV contents and metadata are transmitted to and stored in terminal 
apparatus 9; one option is batch (as opposed to real-time) delivery, i.e. the data is 
stored in advance of presentation, paras. 90, 91, 100]; 

transmitting at least one time prompt to the portable device using second 
receiver signals, the time prompt identifying a time when the content data should be 
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displayed on the portable device such that the content data and a corresponding portion 
of media presentation are displayed in synchronization ["reproduction time" or time 
prompt is used by the terminal to synchronously display metadata corresponding 
to the media presentation, S12 and S14, Fig. 2, paras. 20, 21, 93; Fig. 10, paras. 9, 

79]; and 

executing the content data on the portable device in synchronization with the 
media presentation [terminal integrates, synchronizes, and displays AN contents 
(analogous to the claimed "media presentation") with metadata (analogous to the 
claimed "content data"; para. 149].. 

While Toguri does not perform the above functions in connection with a portable 
device, he does discuss separate display regions for content and metadata [Fig. 19, 
para. 149]. Chen teaches providing a viewer of the media presentation with a portable 
device, the portable device comprising at least two receivers, the portable device being 
capable of displaying content data relating to the media presentation [TCD 120, Fig. 3, 
paras. 27, 31, 43]. Given the separate display regions disclosed by Toguri, it would 
have been obvious to one of ordinary skill that one of the displays could be integrated in 
a portable device. The benefits of remote display units include allowing personalized 
data to be sent to individuals in a public setting, and enabling parental control of content 
at home [See Chen, para. 30]. 
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21 . Regarding claims 49, 55, 60, and 73, Chen discloses a method further providing 
inputs on the portable device adapted to receive information from the viewer [inputs 
129, 130, Fig. 3]. 

22. Regarding claims 51 and 77, Chen discloses a method wherein the portable 
device further comprises at least a transceiver [e.g.. Abstract]. 

23. Regarding claims 52 and 78, Toguri discloses a method wherein the time prompt 
further identifies the content data to be presented at the portable device [e.g., para. 
101]. 

24. Regarding claims 53, 57, 64, 68, 74, 75, and 79, Toguri discloses a method 
wherein content data is transmitted to the portable device at the start or slightly in 
advance of the start of the media presentation [para. 90]. 

25. Regarding claims 54, 59, 60, and 65, Toguri discloses a method of providing a 
viewer of a first media content with a second media content, comprising: 

transmitting the second media content to the portable device [AV contents and 
metadata are transmitted to and stored in terminal apparatus 9; one option Is 
batch (as opposed to real-time) delivery, i.e. the data is stored in advance of 
presentation, paras. 90, 91, 100; storage module 108, Fig. 21]; 
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transmitting a time prompt to the portable device, the time prompt triggering a 
display of the second media content on the portable device such that the second media 
content and a portion of the first media content are displayed in synchronization 
["reproduction time" or time prompt is used by the terminal to synchronously 
display metadata corresponding to the media presentation, S12 and S14, Fig. 2, 
paras. 20, 21, 93; Fig. 10, paras. 9, 79]; and 

displaying the second media content on the portable device at a time indicated 
by the time prompt [terminal integrates and synchronizes, and displays A/v 
contents (analogous to the claimed "media presentation") with metadata 
(analogous to the claimed "content data"; para. 149]. 

While Toguri does not perform the above functions in connection with a portable 
device, he does discuss separate display regions for content and metadata [Fig. 19, 
para. 149]. Chen teaches providing the viewer of the first media content with a portable 
device, the portable device being remote from a display of the first media content, the 
portable device being capable of receiving wireless communication and displaying the 
second media content [TCDs 120, Fig. 3, paras. 27, 31, 43]. Given the separate 
display regions disclosed by Toguri, It would have been obvious to one of ordinary skill 
that one of the displays could be Integrated in a portable device. The benefits of remote 
display units Include allowing personalized data to be sent to individuals In a public 
setting, and enabling parental control of content at home [See Chen, para. 30]. 
26. Specifically with respect to claims 60 and 65, Toguri does not show a 

portable device with inputs. However, the TCD in Chen does provide input means 
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[inputs 129, 130, Fig. 3]. It would have been obvious to one skilled in tlie art to provide 
user inputs to facilitate selection from the various available streams taught by Toguri 
[e.g., paras. 136-138]. 

27. Regarding claims 56, 62, and 67, Toguri discloses a method further comprising 
accumulating the second media content in cache memory of the portable device [AV 
contents and metadata are transmitted to and stored in terminal apparatus 9; one 
option is batch (as opposed to real-time) delivery, i.e. the data is stored in 
advance of presentation, paras. 90, 91, 100; storage module 108, Fig. 21]. 

28. Regarding claims 58, 61 , and 66, Chen discloses a method wherein the first 
media content is live [e.g. a sports broadcast, para. 28]. 

29. Regarding claim 63, Chen discloses a method wherein the second media content 
is related in content with a portion of the first media content [e.g., paras. 28, 30]. 

30. Regarding claim 72, Toguri discloses a method further comprising determining 
what portion of the media presentation data should be displayed based on the contents 
of the at least one time code ["reproduction time" or time prompt is used by the 
terminal to synchronously display metadata corresponding to the media 
presentation, S12 and S14, Fig. 2, paras. 20, 21, 93; Fig. 10, paras. 9, 79; terminal 
integrates, synchronizes, and displays A/V contents (analogous to the claimed 
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"media presentation") with metadata (analogous to the claimed "content data"; 
para. 149]. 

31 . Regarding claims 50 and 76, Chen discloses a method wherein the at least one 
time prompt is transmitted by way of infrared signal or RF signal [para. 40]. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Timothy R. Newlin whose telephone number is (571 ) 
270-3015. The examiner can normally be reached on M-F, 8-5 EST. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chris Kelley can be reached on (571 ) 272-7331 . The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Christopher Kelley/ 
Supervisory Patent Examiner, Art 
Unit 2424 
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